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ABSTRACT 



Offering vertical services to subscribers and service provid- 
ers is an avenue to immediately improve the competitiveness 
of digital subscriber line access service, for example of the 
type offered by a local exchange carrier. To deliver high- 
quality vertical services, however, the underlying ADSL 
Data Network (ADN) or the like needs to establish Quality 
of Service (QoS) as a core characteristic and offer an 
efficient mechanism for insertion of the vertical services. 
The inventive network architecture introduces QoS into the 
ADN, in a manner that enables the delivery of sophisticated 
and demanding IP-based services to subscribers, does not 
affect existing Internet tiers of service, and is cost-effective 
in terms of initial costs, build-out, and ongoing operations. 
The architecture utilizes a switch capable of examining and 
selectively forwarding packets or frames based on higher 
layer information in the protocol stack, that is to say on 
information that is encapsulated in the layer-2 information 
utilized to define normal connectivity through the network. 
The switch enables segregation of upstream traffic by type 
and downstream aggregation of Internet traffic together with 
traffic from a local vertical services domain. By implement- 
ing a two-tier queuing structure in the downstream direction, 
traffic with a virtual circuit and traffic between the different 
virtual circuits that are destined for the same downstream 
DSLAM can be prioritized according to service type and/or 
Internet Service Provider. 

22 Claims, 9 Drawing Sheets 
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TRAFFIC QUEUEING FOR REMOTE 
TERMINAL DSLAMS 

RELATED APPLICATION 

This application is a continuation in part of U.S. patent 
application Ser. No. 09/635,695, filed Aug. 10, 2000 entitled 
"SUPPORT FOR QUALITY OF SERVICE ADN VERTI- 
CAL SERVICE IN DIGITAL SUBSCRIBER LINE 
DOMAIN" and'U.S. patent application Ser. No. 09/688,213 
filed Oct. 16, 2000 entitled "CONGESTION AND 
THROUGH-PUT VISIBILITY AND ISOLATION", the dis- 
closures of which are incorporated herein entirely by refer- 
ence. 

FIELD OF THE INVENTION 

The concepts involved in the present invention relate to 
techniques for implementing data communication services, 
for example in a local access network utilizing digital 
subscriber line technology, to support quality of service 
(QoS) and local introduction of vertical services. Other 
concepts involved in the present invention relate to regulat- 
ing downstream traffic, for example, traffic going to a remote 
terminal DSLAM. 

BACKGROUND 

Modem society continues to create exponentially increas- 
ing demands for digital information and the communication 
of such information between data devices. Local area net- 
works use a network, cable or other media to link stations on 
the network for exchange of information in the form of 
packets of digital data. These networks have proven quite 
successful in providing data communications in commercial 
applications. However, the common local area network 
architectures require installation of specialized wiring and 
use of specific wiring topologies. For example, the most 
popular network protocols, such as Ethernet, require special 
rules for the wiring, for example with regard to quality of 
wire, range of transmission and termination. Furthermore, to 
extend communications to a wider domain still requires 
connection of at least one node of the local area network out 
to a wider area network, such as the network of an Internet 
Service Provider (ISP). High speed links enabling such wide 
area access from a LAN domain, for example using H lines, 
are quite expensive and justified only for hi-end commercial 
users. 

The most common form of computer-to-computer com- 
munication in use today, particularly for wide area 
communications, still relies on modems and analog tele- 
phone network connections. The telephone-based operation 
provides the voice grade analog modem a unique power, the 
necessary connections are virtually ubiquitous. Such 
modems can communicate via almost any telephone line or 
wireless telephone (e.g. cellular) to any other such telephone 
connection, virtually anywhere in the world. The telephone 
network, however, was designed to provide approximately 
3.3 kHz of analog voice bandwidth. Consequently, the data 
rates that are possible through the telephone network are 
quite low. Even with a variety of recent enhancements, the 
data speeds remain at or below 56 kbps. 

Integrated Services Digital Network (ISDN) offers some- 
what faster data communications and the capacity for con- 
current data and voice telephone services. The 160 kb/s 
capacity carries two bearer (B) channels, each at 64 kb/s, one 
data (D) channel at 16 kb/s and overhead information in a 16 
kb/s embedded operations channel (EOC). The two 
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B-channels may be used separately, for example for one 
voice telephone call and one data communication session. 
The D-channel typically is used for signaling, for call set-up 
and the like. Some applications allow aggregation of the 

5 channels, to combine the B-channels and possibly the 
D-channel to provide data communications up to the com- 
bined rate of 144 kb/s. However, these data rates offered by 
ISDN already are too slow for many multimedia applica- 
tions. The high-speed and wide availability of modem 
personal computers (PCs) continually gives rise to ever 
more sophisticated multimedia applications. Communica- 
tions for such applications, typically between the PC and the 
Internet, already are driving the need for speed to rates far 
above those available on normal ISDN lines. 

15 A number of technologies are being developed and are in 
early stages of deployment, for providing substantially 
higher rates of data communication, for example ranging 
form 640 kb/s to 7.1 Mb/s. For example, cable television 
companies are now beginning to offer 'cable modem' 

20 services, which allow customers to communicate data over 
available bandwidth on the coaxial cable of a cable televi- 
sion network. After considering several other options, a 
number of the local telephone carriers are working on 
enhancements to their existing copper-wire loop networks, 

25 based on various xDSL technologies. 

The term xDSL here is used as a generic term for a group 
of higher-rate digital subscriber line communication 
schemes capable of utilizing twisted pair wiring from an 
office or other terminal node of a telephone network to the 

30 subscriber premises. Examples under various stages of 
development include ADSL (Asymmetrical Digital Sub- 
scriber Line), HDSL (High data rate Digital Subscriber 
Line) and VDSL (Very high data rate Digital Subscriber 
Line). 

35 The telephone carriers originally proposed use of ADSL 
and similar high-speed technologies to implement digital 
video services, for example in networks sometimes referred 
to as video 'dialtone' networks. The ADSL line technology 
provided a mechanism for high-speed transport of MPEG 

40 encoded video information to video terminal devices in the 
customers' homes. Examples of such ADSL-based video 
dialtone networks are disclosed in U.S. Pat. Nos. 5,247,347, 
5,410,343 and 5,621,728. The carriers are now deploying a 
range of xDSL data services targeted at high-speed Internet 

4 5 access and high-speed access to private data networks. U.S. 
Pat. No. 5,790,548 to Sistanizadeh et al. discloses an 
example of an ADSL based data network, e.g. for high-speed 
access to the Internet and to corporate LANs. 
The current design goals of DSL data networks for 

50 Internet access do not support high-end vertical services, 
that is to say services demanding IP-based applications that 
require assurance of some level of quality of service (QoS). 
For example, packet-switched Voice over IP (VoIP) requires 
low latency, low jitter (i.e., a relatively constant bit rate), and 

55 non-correlated packet loss. Streaming video has similar 
requirements, and in addition, requires high bandwidth. DSL 
data networks designed to support high speed Internet and 
Intranet access have been optimized to support traffic that is 
bursty and is not sensitive to latency or jitter. For example, 

60 current implementations supporting ATM cell traffic employ 
the Unspecified Bit Rate (UBR) class of service, which does 
not provide any bandwidth or delay guarantees. 
Consequently, transport of video materials through such 
DSI, data networks inflicts video delays, loss of audio/video 

65 synchronization, and image fragmentation. 

Furthermore, lengthy bandwidth intensive sessions for 
video or other broadband applications may degrade the 
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throughput to all other subscribers served through a shared the voice telephone traffic. Thus each ADSL unit 113 pro- 
node, such as a gateway router or a concentrated link. For vides a connection for telephone traffic from the associated 
two-way video, upstream will have even worse quality and line 300 to the POTS switch 103. 

throughput problems, due to the best effort nature of the DSL The ADSL units 113 in the CO (ATU-Cs) essentially act 
data network implemented for Internet access and because 5 as modulator/demodulators (modems) for sending and 
the upstream bandwidth is significantly less than that of the receiving data over the subscriber telephone lines 300. On 
downstream channel. mc nc twork side, each of the ATU-Cs 113 connects to the 
To appreciate the situation and problems, it may be MUX 115. The MUX 115 multiplexes and demultiplexes the 
helpful here to consider an ADSL data implementation of a upstream and downstream data for the ADSL modems 113 
local access network, as a representative example, in some- 1° and provides a connection to a high-speed link 119. Through 
what more detail. FIG. 7 is a block diagram of a typical subtending, the MUX 115 may also provide a data concen- 
ADSLdata network of the type currently in-use by a number tration for the communications over the link 119. 
of incumbent and competitive local exchange carriers to [ n a typical implementation, the concentrated data corn- 
provide high-speed access to Internet Service Providers munications utilize a DS-3 link 119. However, because of 
(ISPs) and thus to the Internet. FIG. 8 provides an alternative ]S increasing traffic demands, it is becoming necessary to 
functional illustration of the elements of such a network. Of upgrade the link 119 to SONET optical fiber, such as OC-3 
particular note, FIG. 8 shows the various protocol stacks in or m cases eV en OC-12. The link 119 provides 
association with the appropriate network elements. two-way data communication between the central office 100 
As shown in FIG. 7, a central office (CO) 100 provides and a data hub 121. In practice, this is a relatively long or 
plain old telephone service (POTS) and digital subscriber 20 wide area link using expensive interoffice facilities, 
line data service for a number of customers. For purposes of On the upstream side, the high-speed interoffice link 119 
discussion, assume that the equipment at each of the various terminates on an ATM switch 123 for the ADSL data 
customer premises 200 connects directly to the CO 100 via network (ADN). Although only one link 119 appears in the 
twisted pair type copper wiring 300. In an actual drawing, the asynchronous transfer mode (ATM) switch 123 
implementation, many customers may connect through such will typically service a number of DSLAMs 111 in various 
wiring to a remote terminal linked to the CO via optical fiber. end offices via similar DS or OC links. The ATM switch 123, 
At each customer premises 200 in our example, the in turn, provides a high-speed connection to a gateway 
copper loop 300 carrying both the POTS and ADSL signals router 125 coupled to an ATM cell relay network 129. 
connects through a Network Interface Device (N1D) 201 3Q Typically, the ATM switch 123 will aggregate traffic from a 
placed at the side of the home. A two pair loop is installed number of such links 119 onto an OC-3 or higher rate 
from the NID to the location where the ADSL unit 203, SONET link to the router 125. The router 125 and the cell 
typically an XTU-R modem, is located in the home. One pair relay network 129 enable transport of ATM cells for the 
connects all of the signals on the line 300 from the NID 201 subscribers to and from equipment of one or more Internet 
to the ADSL- modem 203. Within the ATU-R type modem 35 Service Providers (ISPs), shown by way of example as a 
203, a passive splitter/combiner type filter segregates the concentrator 131 coupled to the public packet switched 
POTS signal and the data signals. The POTS signal is network commonly known as the Internet 132. 
transmitted over the second twisted pair back to the NID The illustrated local access type ADN network provides 
201. The POTS line is then connected to the in-home wiring ATM cell transport from a customer premises 200 to the ISP 
extensions at the NID 201, for distribution to one or more 4Q concentrator 131. The ATM cells serve as the layer-2 routing 
standard telephone devices 205 in the home. 0 r switching protocol for the lowest level definition of 
Within the ATU-R type ADSL modem 203, the down- connectivity between two points of the network. Higher 
stream coded ADSL signal is demodulated and decoded to level protocols ride within the ATM cells, 
an appropriate data interface protocol for connection to the The ATU-Rs 203 and the customer premises data equip - 
PC 215. The PC 215 or other data device (FIG. 8) also sends 45 me nt 215 connect via an Ethernet coupler. The 
data to the ADSL modem 203. The modem 203 modulates customers'equipment communicates across the ADSL data 
the upstream data and transmits appropriate signals over the network utilizing Ethernet, and the wide area communica- 
line 300 2 , or 300 2) to the corresponding modem 113^ or tion involves transport of Internet protocol information 
113 2 in the CO 100 (FIG. 7). The ATU-R interface may typically in TCP/IP frames within Ethernet frames. The 
support bridging, such that multiple users can share the 50 Ethernet frames carrying the TCP/IP frames are adapted into 
ADSL modem 203. for two-way data communication ATM cells. Attention is directed to the protocol stacks 
through the CO 100. illustrated in the lower half of FIG. 8. 

The lines 300 for the customer premises 200 connect To efficiently provide cell relay, each customer is assigned 
through the main distribution frame (MDF) 101 to a Digital a n ATM virtual circuit that extends from the ATU-R 203 in 
Subscriber Line Access Multiplexer (DSLAM) 111. The 55 the respective customer premises 200 to the gateway router 
DSLAM includes a bank of ADSL terminal units of the type 125. Although it was originally envisioned that ATM would 
intended for central office applications, identified as ATU-Cs support switched logical channels or virtual circuits, to date, 
113. The DSLAM also includes a multiplexer/demultiplexer sucn logical switching has proven impractical to implement 
(MUX) 115. an d administer. Consequently, current practical ATM net- 
Within the DSLAM 111, each customer line 300 connects 60 works actually utilize permanent virtual circuits, not 
to an assigned ADSL terminal unit 113 in the central office switched virtual circuits. For a given subscriber, the carrier 
(ATU-C). In the example illustrated, the first customer's line therefore provisions an ATM permanent virtual circuit from 
300j connects through the MDF 101 to a first ATU-C 113 1 the ATU-R 203 to the gateway router 125. The carrier 
in the CO 100. The second customer's line 300 2 connects programs one or more nodes along the path of that logical 
through the MDF 101 to a second ATU-C 113 2 in the CO 65 circuit, particularly the DSLAM 111, to regulate traffic on 
100. The ATU-C type ADSL units 113 include appropriate the virtual circuit to the upstream and downstream rates 
frequency dependent combiner/splitters, for segregating out corresponding to the grade of service to which the particular 
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customer subscribers. All data traffic for the subscriber goes higher level protocols, particularly Internet protocol (IP), 

over the entire length of the permanent virtual circuit, and Such a migration strategy to implement new services creates 

most if not all nodes along that path limit that traffic to the severe problems. For example, in the network of FIG. 7, if 

rates of the subscription as defined in the provisioning data. * customer at premises 200, desired to order a video on 

Hie virtual circuit may be thought of as a solid pipe. All s demand, the customer would communicate via the assigned 

A ~- . u u*u *• i *l <uu vi i permanent virtual circuit and the ISP to a server on the 

traffic passes through the entire length of the pipe-like virtual f , * J(L . L1 

./ „ * , L rL j Internet 132. The server would send the video stream back 

circuit, regardless of howmany switches or other nodes the th h ^ m ^ Kp { m ^ ^ 

circuit passes through The layer-2 protocol defining the relay * etwork 129 and the virtual circuit from the router 125 

circuit carries all of the higher level traffic end-to-end. tQ the 203 for handoff to a pc Qr the likc at 215 If 

Higher layer protocols are visible only at the ends of the 10 ^ ^ q{ ^ requested videQ ^ ds me cust omer's 

pipe Hence, any traffic flow processing intended to utilize su5scription wte me cust omer could not view the video in 

the higher layers must occur at some point past one end or rea] ^ dufing ^ downloadi Even if the rate of the 

the other end of the virtual circuit. requested video is below the customer's subscription rate, 

The gateway router 125 also terminates permanent virtual loading in the Internet or the local access network may 

circuits through the cell relay network 129 going to/from the impose delays and/or jitter in communication of some 

ISP concentrators 131. The gateway router 125 aggregates segments of the requested video. Assuming that the hub 121 

traffic between a number of subscribers and each respective the links 119 implement a subscriber concentration, 

ISP. The ISP equipment 131 typically implements a varia- ordering of videos or similar broadband files from the 

tion of a point-to-point protocol (PPP) specifically adapted Internet 132 quickly consumes the shared resources through 

to ride over Ethernet, referred to as "PPP over Ethernet" thc hub 121 and the links 119, reducing the rates of service 

(PPPoE). The virtual circuits to the ISPs, however, do not provided to other customers seeking concurrent Internet 

have sufficient capacity to simultaneously carry all sub- access. 

scriber traffic at the maximum rates of the customers' [t might be possible to increase the capacity of the links 

subscriptions. The MUX 115, the ATM switch 123, and the n9 and/or the hubs U i ; however, this tends to increase the 

gateway router 125 concentrate and regulate the subscriber car rier J s recurring costs and often makes the overall service 

traffic going to and from the ISPs, typically on some type of ( s ) of me networ k economically impractical, 

"best efforts" basis. It ^ s beefl SU g ges t e d to provide customers guaran- 

In a typical Internet access service offering, the most teed quality of services for some portion of their 

expensive service tier provides 7.1 Mbps for downstream 3Q communications, by segregating the traffic carried between 

communication and 680 kbps for upstream communication. the customer premises and the hub 121. This would require 

The next grade of service provides 1.6 Mbps for downstream assigning a plurality of ATM permanent virtual circuits to 

communication and 90 kbps for upstream communication, cacn subscriber, one for each different guaranteed level of 

whereas the lowest tier of service provides 640 kbps for quality of service and one for all other Internet traffic for the 

downstream communication and 90 kbps for upstream com- 35 subscriber. Administration and provisioning of one virtual 

munication. The maximum grade of service offered to an circuit per subscriber is already complicated, and the number 

individual subscriber depends on the rates for which the of virtual circuits through any given ATM node is limited by 

subscriber's line can qualify, although the subscriber may current equipment designs. Expanding the number of per- 

opt for a lower rate service since the higher-rate service is manent virtual circuits per subscriber to support multiple 

more expensive. 4Q QoS tiers of service therefore would be quite expensive, and 

The approach outlined above relative to FIGS. 7 and 8 the management thereof would become a nightmare. To 

works well for Internet access if the traffic relates to web support an increased number of virtual circuits, many having 

access, file transfers and the like, which do not require guaranteed QoS requiring some substantial minimum rate at 

guaranteed quality of service. Various segments of the all times, would also require that the operator substantially 

Internet industry, however, are rapidly developing new mul- 45 upgrade the network to increase the end-to-end capacity all 

timedia services and applications that already are pushing the way to the wide area network 132. 

the capabilities of such a network. For example, Furthermore, to actually receive the desired QoS requires 

increasingly, Internet traffic includes a number of types of that all elements involved in the communication must guar- 

com munication that require a guaranteed quality of service. antee the desired level or quality of service. For communi- 

Voice telephone communication over IP is extremely sensi- 50 cations across the public Internet 132, this means that 

live to latency and jitter. The permanent virtual circuits various nodes and links on the public Internet must be 

provide an unspecified bit rate (UBR) service and do not available and capable of providing a guarantee of the desired 

guarantee any minimal amount of delay or jitter. Also, QoS. In point of fact, few nodes on the public Internet 

because the rates are set by subscription, the service tends to actually support any type of QoS. Hence, even if the ADN 

be relatively inflexible. Some services, such as multicasting 55 supported a desired QoS, most subscribers would not benefit 

of broadband information from the Internet into the local from that service because their communications over the 

access ADN for a large number of concurrent users, can public Internet would have no QoS guarantee, and would 

quickly overload one or more nodes or critical links of the suffer from the usual problems of latency and jitter, 

network, for example the link 119 between the DSLAM 111 Consequently, current deployments of ADSL-based data 

and the ATM switch 123 at the hub 121. 60 networks, such as shown in FIGS. 7 and 8 generate many 

Most industry experts propose to increase the services customer complaints. From the customer perspective, the 

available via the public Internet. However, because the service does not deliver the data rates that the customer pays 

higher layer protocols are visible only on the Internet side of for on a consistent basis. The customer typically blames 

the virtual circuit "pipe/' these services all must be imple- such problems on network equipment failure. In fact, most 

men ted out past the end of the virtual circuit, at least behind 65 of the problems already are due to virtual circuit congestion 

the gateway router 129 and most likely in the public problems, of the kinds outlined above. Essentially, the ADN 

network, where it is possible to view and route based on network is crippled by the unpredictable nature of the 
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service levels that the customers perceive due to congestion 
on the ADN and on the public Internet. 

Another area of problems is that the ADN does not offer 
the carrier any technique for offering its own differentiated 
service applications. To compete with other service 5 
providers, the carrier operating the ADSL-based data net- 
work needs to introduce its own multimedia services, for 
example, its own video services to compete with video 
services of cable television companies (that offer competing 
Internet access services). As noted above, however, intro- io 
duct ion of a new service, such as true video on demand or 
broadcast video requires communications via the public 
Internet 132. This is true even if the carrier operating the 
network of FIGS. 7 and 8 wanted to initiate its own video 
service(s). is 

Some arrangements of equipment for providing xDSL 
connectivity to subscribers use a remote terminal DSLAM 
(RTDSLAM) located between the central office DSLAM 
and the subscribers' ATU-R. In such an environment, down- 
stream congestion can occur at the RTDSLAM resulting in 20 
downstream cells being unexpectedly dropped. A compre- 
hensive approach to improving the ADN service should also 
provide a method of prioritizing downstream data so that 
downstream high-priority cells through an overburdened 
RTDSLAM are not dropped while lower priority cells 25 
continue to be delivered. 

Hence, there is an ongoing need to improve the architec- 
ture and operation of a digital subscriber line data commu- 
nication network, particularly to facilitate finer gradation of 
services within the local network. The need, first, is for such 
a local network to support introduction of services on a 
* vertical* basis within the local access network separate and 
apart from the common forms of Internet traffic, both for 
commercial differentiation and for increased security. In a 
related need, the local network needs to support a number of 
different levels of quality of service (QoS). Any enhance- 
ment to the network should also fulfill the need to shape 
downstream traffic through an RTDSLAM and provide for 
different tiers of service for subscribers. 

40 

SUMMARY OF THE INVENTION 

A general objective of the invention is to implement an 
enhanced digital communication network for subscriber 
lines that supports vertical introduction of new communi- 
cation and/or multimedia services. 45 

A further objective is to support multiple levels or grades 
of quality of service within the access network. 

Another objective of the invention relates to improvement 
of the cost effectiveness of the data network, for example, by 5Q 
reducing the demand for high-capacity interoffice links 
while increasing the bandwidth available at the network 
edge for at least some types of services. 

A related objective is to provide a technique for introduc- 
tion of new high -end services near the network edge, from 55 
a domain that is more secure and therefore less subject to 
hacker attacks. 

A further objective of the invention is to support QoS 
and/or local introduction of vertical services, without the 
need to assign multiple virtual circuits or the like to each 60 
subscriber. 

A further objective of the preferred embodiment is to 
support different priority levels of downstream traffic within 
a permanent virtual circuit (PVC). 

An additional objective of the preferred embodiment is to 65 
support different tiers of downstream service among differ- 
ent PVCs. 



,657 Bl 

8 

A further objective of the preferred embodiment is to 
shape traffic to an RTDSLAM so that cells are not dropped 
in a first-come, first-served manner at the RTDSLAM. 

Aspects of the invention relate to unique' methods and 
network architectures for providing a combination of wide 
area internetwork service and vertical communication ser- 
vices via a local access network. Other aspects of the 
invention relate to a particular switch developed to facilitate 
a unique form of routing, for example to support of QoS and 
vertical service insertion. 

The preferred embodiments alleviate the above noted 
problems by providing an intermediate node, typically an 
enhanced switch, to segregate upstream traffic based on 
analysis of the type of communication. This analysis utilizes 
protocol information contained in each communication, for 
a protocol higher than the switching protocol, that is to say 
higher than a protocol used to define the customer's logical 
circuit. In an implementation utilizing ATM, for example, 
the logical circuit is a virtual circuit, and the node examines 
the protocol information for layers above the ATM layer. 
One type of traffic remains on the virtual circuit, whereas 
other traffic is handed off to a vertical services domain. The 
node also provides a point to aggregate traffic from the from 
the vertical services domain with other traffic on the sub- 
scriber's logical circuit, for transport to the customer pre- 
mises equipment. 

To this end, the preferred embodiments use an ATM 
switch having routing/processing capabilities at the higher 
layer, for example at the layer-3 protocol or above, in close 
proximity to a DLSAM. The links between the DSLAM and 
this switch can be of any desired high capacity because they 
are short and therefore relatively low in cost. Consequently, 
the DSLAM and the new ATM switch can support relatively 
high bandwidth from that node to the customer premises. To 
utilize the increased bandwidth and support new services, 
the modems on the opposite ends of the digital subscriber 
line negotiate and operate at the maximum rate that the line 
conditions will permit. 

The ATM switch essentially subdivides the traffic asso- 
ciated with each subscriber line. One branch goes to a 
gateway router and hence to one or more ISP(s) at the rate 
corresponding to the Internet access subscription. It may be 
helpful to consider this as long distance or wide area traffic 
for the subscriber. The other branch is for local traffic, to and 
from the locally connected vertical services domain. The 
interconnection to the ISP domain supports QoS in the 
downstream direction. Also, the interconnection to the ver- 
tical services domain supports QoS and introduction of 
vertical services not easily provided from the public Internet, 
such as video on demand, multicasting, and voice over IP. 
The vertical services domain is relatively secure since it is 
not accessible from the public Internet. 

In operation, the access network will still support a logical 
circuit in the form of a virtual circuit to the gateway router 
for each customer, for example in the form of an ATM 
permanent virtual circuit. That circuit is provisioned for the 
subscriber's desired grade or quality of Internet access 
service. The subscriber line, however, supports at least the 
same and often a higher rate service, for example via 
rate-adaptive ADSL communication over a twisted wire line. 
In the upstream direction, the ATM switch examines at least 
one aspect of each data transmission relating to a logically 
higher level of protocol, e.g. in a layer 2 protocol encapsu- 
lated in ATM, or at layer 3, layer 4, or higher. From the 
higher level information, the switch determines the type of 
transmission and segregates the upstream transmissions on 



04/15/2004, EAST Version: 1.4.1 



US 6,424,657 Bl 

9 10 

the subscriber's virtual circuit. One type of transmission tions or code for performing a sequence of steps in a 

continues on the virtual circuit, e.g. for Internet transport. machine -readable readable form. Examples of physical 

Any and all other types, however, go to the vertical services forms of such media include floppy disks, flexible disks, 

domain. In the downstream direction, the ATM switch hard disks, magnetic tape, any other magnetic media, a 

aggregates any communications coming from the vertical s CD-ROM, any other optical media, a RAM, a ROM, a 

services domain together with downstream transmissions on PROM, an EPROM, a FLASH-EPROM, any other memory 

the virtual circuit from the Internet. chip or cartr idge, as well as media bearing software in a 

The vertical services domain also represents a communi- SC annable format. Acarrier wave type of medium is any type 

cation network. The vertical services domain, however, of signal that may carry digital information representative of 

preferably takes the form of a data network optimized for 3Q thc instructions or ^ performing the sequence of steps, 

ocd transport of vertically ^injected services, that is to say guch a carder waye be receiyed yia a wireline Qr 

local data traffic. In view of its local nature it is easier and fi5er . optic network> via a modeni) or as a rad io-frequency or 

more cost effective to provide high bandwidth services/Rie inffared &{ ^ Qr other of s[ } which a ^ 

vertical services network, for example, could take the form Qr me ^ ma recdve and decode 

of a giga-bit Ethernet type local area network. Also, it is 1C A ,,. . , . . 

easier to adapt the vertical services network to support 15 . Additional _ objects advantages and novel features of the 

service level agreements with customers with regard to "^ntion will be set forth m part in the description which 

quality of service. In many cases, it actually is sufficient to f ° llows ' and in ^ { wlU bec ? m u e *PP arem 10 ^ose skilled in 

support QoS on the one hop through the ATM switch, itself. thc art u ? on examination of the following and the accom- 
* „ „ . A , 4 _ panying drawings or may be learned by practice of the 

To support the QoS requirements, a feature of the pre- in • «• tl l- * j j * r*i_ • 

r j l j- r ■ i ^ * * j * • invention. The objects and advantages of the invention may 

f erred embodiments mvolves certain queumg and tagging , v , - ' . - . * c . . . 

.... . t , r ** 11 *t_ l he realized and attamed by means of the instrumentalities 

operations within the ATM switch. Essentially, the switch , 4 - «■ i i ■ < j * • *i_ j j 

. . . L - , * i and combinations particularly pointed out m the appended 

will maintain two or more queues for each permanent virtual . . r J r rir 

claims 

circuit. The switch distinguishes the queues based on impor- 
tance. As the switch receives cell transmissions for transport 2 $ BRIEF DESCRIPTION OF THE DRAWINGS 
over the virtual circuit to the customer premises, the switch 

will internally tag each cell as to its importance level and The drawing figures depict preferred embodiments of the 

place the cell in the appropriate queue. An access control list present invention by way of example, not by way of limi- 

(ACL) is used to control servicing of the multiple queues for tations. In the figures, like reference numerals refer to the 

each PVC in order to transmit cells to a second tier queue. 30 same or similar elements. 

The particular ACL is selected to implement QoS in con- piG. 1 is a functional block diagram of a digital subscriber 

formance with the subscriber's service level agreement with une data network supporting enhanced services in accord 

the carrier and/or agreements between the carrier and the w ith the inventive concepts. 

vertical services and internet services providers. Tbe second FIG. 2 is a slightly modified functional block diagram of 

Iter queue can then be serviced m accordance with down- 35 networkof mG _ 1, illustrating the protocol stacks used in the 

stream facility capacities. various netwofk elements 

Within the one virtual circuit assigned to the individual rT „ - , - , , , , ,. c , 

t , . 4 . ., r FIG- 3 is a functional block diagram of the network 

subscriber, the invention provides multiple tiers of service, , . ■ i i * % T aow u- u *u 

r , . ' . tt 1t . , \ , c rt o ai * J ir I showing the service level agreements (SLAS) for which the 

preferably with multiple levels o QoS Ako, at different gs 4 QoS 

sections along the virtual circuit pipe, the network pro- 40 r rr r 

vides different levels of rate shaping. All layers and all FIG - 4 is a lo g ical diagram of the functional elements of 

services are available at the home, but different services an switch » for usc in thc inventive network of FIGS, 

receive different treatments in the network conforming to the A J - 

different levels of QoS. The inventive approach, however. FIG. 5 is block diagram of a portion of the network, useful 

does not require each subscriber to have multiple virtual 45 in illustrating the location and function of a remote terminal 

circuits. DSLAM. 

Services provided on the vertical services domain appear FIG. 6A is a block diagram of a portion of the network of 

as IP data services. Virtually any communication service FIG. 5, showing a two-tier queue structure in a vertical 

may utilize the vertical services network and through it to services switch. 

gain access to the carrier's local customer base, simply by 50 FIG. 6B is a logical view of the different permanent 

providing an IP interface for coupling to the vertical services virtual circuits switched through the vertical services switch 

network. For example, it is a simple matter to connect any 0 f pjQ t 5^. 

digital source of broadcast audio or video information, such FIG. 7 a block diagram of a prior art asymmetrical digital 

as a direct satellite broadcast receiver system similar to those subscriber line data networ k. 

used today in residential applications, through an IP inter- 55 rrr ^ 0 . , t1 r 

face. Such a broadcast source and interface can provide the u 8 1S a slight^ modified functional block diagram of 

full range of received video services, over the vertical the pnor art network illustrating the protocol stacks used in 

services network. The access data network may distribute the vanous network elements, 

the video programming to a number of access switches DETAILED DESCRIPTION OF THE 

widiin a loca geographic area, The switch provides ^ an 60 PRESENTLY PREFERRED EMBODIMENTS 
optimum point for frame or cell replication for multicasting 

services. Hence, in our video example, the switch replicates The inventive network architecture introduces QoS into 

and distributes frames for the broadcast service over the the ADN, in a manner that enables the delivery of sophis- 

digital subscriber line circuits to customers desiring to view ticated and demanding IP-based services to subscribers. The 

the programming. 65 architecture does not affect existing Internet tiers of service 

A computer readable medium, as used herein, may be any such that the promised rates for such access appear the same 

physical element or carrier wave, which can bear instruc- as offered today. Also, the new architecture is cost-effective 
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in terms of initial costs, build-out, and ongoing operations. 
The architecture utilizes an access switch or router capable 
of examining and selectively forwarding packets based on a 
relatively higher layer of the protocol stack, that is to say 
based on information encapsulated within the layer-2 infor- 
mation utilized as the lowest level definition of connectivity 
through the network. The access switch enables segregation 
of upstream traffic by communication type and downstream 
1 aggregation of wide area traffic together with traffic from a 
local vertical services domain. 

In accord with the invention, the access switch examines 
the higher-level protocol information in the upstream com- 
munications to segregate traffic into two or more streams 
based on traffic type. A logical circuit provisioned for the 
subscriber extends from the customer premises through the 
switch to a node providing service to the packet switched 
network, typically on the Internet. The provisioning of this 
circuit defines a contiguous connectivity for the logical 
circuit, in the layer-2 protocol utilized by the network. 
Higher level protocols ride within this particular layer-2 
protocol, including some protocols that are often considered 
themselves to be layer-2 protocols. 

The analysis of upstream packets to determine higher- 
level type enables segregation of the upstream traffic into 
two or more upstream flows. For example, this allows the 
switch in the preferred embodiment to keep traffic bound for 
the packet switched internetwork on the logical circuit but 
route all other traffic onto another network, in this case a 
local network for vertical services. In the preferred 
embodiment, from the access switch or router to the packet 
switched network, the provisioning for the logical circuit 
limits the rate(s) of communication to those defined by the 
grade of service to which the customer subscribes. From the 
customer premises to the switch, however, the communica- 
tions run at the optimum rates that the facilities can physi- 
cally support, e.g. the maximum rates that the ADSL 
modems or the like can adaptively establish for the particu- 
lar subscriber's line. 

In the downstream direction, the switch aggregates traffic 
for each subscriber. The switch receives the rate -limited 
traffic from the packet switched network, on the subscriber's 
logical circuit. The switch also receives any downstream 
traffic intended for the subscriber, from the vertical services 
network. The switch combines this traffic and sends the 
combined communications downstream over the subscrib- 
er's logical circuit to the customer premises, at the optimum 
downstream rate that the subscriber's facilities can support. 

In combining the traffic, within a virtual circuit, from the 
vertical services network and the packet switched network, 
a two-tier queuing operation can be utilized to prioritize the 
downstream traffic. The cells in each traffic stream can be 
examined at a layer above the data link layer to determine 
what type of application (e.g., voice, video, data, etc.) is 
associated with each cell. Using this information the cells 
can be prioritized into a first set of queues for each virtual 
circuit. Subsequently, using a rule-set or access control list 
(ACL), The switch can service the sets of queues for the 
various virtual circuits to populate a second tier queue set 
according to relative priorities between the different virtual 
circuits. Accordingly, the data exiting the second tier queue 
set is prioritized within each virtual circuit and between the 
different virtual circuits. 

FIG. 1 provides a high-level functional illustration of an 
exemplary digital subscriber fine network, specifically an 
ADSL data network 10, implementing the various concepts 
of the present invention. FIG. 2 provides an alternative 



'4,657 Bl 

12 

functional illustration of the elements of such a network. Of 
particular note, FIG. 2 shows the various protocol stacks 
associated with the appropriate network elements that utilize 
those stacks. The end -user may be a single PC user or a 

s small business or a residential LAN user. The data equip- 
ment of such users typically includes servers and PCs and 
may include a variety of other devices, such as fax machines, 
televisions, recorders and remote controlled appliances, hav- 
ing data communication capabilities, 

10 The customer access link comprises an xDSL twisted pair, 
although those skilled in the art will recognize that the 
invention is readily adaptable to networks using other types 
of links to the subscriber premises. In the illustrated 
embodiment, the network 10 supports ADSL, which the 

15 carrier may offer in grades supporting 640 kbps, 1.6 Mbps 
or 7,1 Mbps (downstream) rates for Internet access. The 
actual communications over the DSL loops, however, run 
adaptively at the maximum rates that the line conditions 
allow. 

20 The ADSL-based local access data network or " ADN" 10 
provides access to two different network domains for com- 
munication services. The two network domains are logically 
separate. In most implementations, the first domain may be 
considered as a long distance or wide area domain, whereas 

25 the second domain is a local network domain. In the 
illustrated example, the ADN 10 provides access to a first 
domain in the form of a wide area internetwork, such as the 
public Internet, corporate local area networks (LANs), and 
the like, represented by the network cloud 11 for the ISPs. 

30 The high speeds available through the local network 10 

enable a wide range of communications, for example, of text 

data, of video data, for multimedia, for web browsing, of 

transfers of files, for database searching, and the like via the 

network(s) 11. 
35 . 

In accord with the invention, the ADSL-based local 

access network 10 also offers access to a wide variety of 

other IP-based services through a local data network 13 

serving as the vertical services domain (VSD). The vertical 

40 services typically are high-end services requiring certain 

QoS levels and often having a certain local characteristic. 

Examples of the vertical services are discussed in more 

detail later. 

The vertical services network offers an efficient domain 
45 from which the carrier can locally inject high -end services 
and/or services of other local providers. Because the vertical 
services domain is separate from the public Internet, equip- 
ment providing the vertical services is subject to attacks 
directly from the public Internet. 
50 As shown in FIGS. 1 and 2, a central office (CO) 15 
comprises one or more DSLAMs 17 and L3/4 ATM switch 
19. Elements of the CO 15 providing plain old telephone 
service (POTS) have been omitted for simplicity of 
illustration, since they are generally similar to those shown 
55 in FIG. 7. 

The switch 19 is designated as an "L3/4" switch here as 
a matter of convenience, to illustrate that the switch 19 has 
the capability to make selective packet forwarding decisions 
based on protocol information at some level that is above the 

60 L2 level that the switch normally utilizes to define or 
establish logical circuit connectivity. It will be recognized, 
however, that some of the protocols, although higher than 
the ATM type level 2 protocol used by the preferred switch 
are themselves often thought of as level 2 protocols even 

65 though they are above or encapsulated in the ATM type level 
2 information. Also, decisions as to the selective forwarding 
may be made in response to monitoring of any level of the 



04/15/2004, EAST version: 1.4.1 



US 6,424,657 Bl 

13 14 

protocol stack above the L2 level that the switch normally over the individual subscriber lines. Essentially, the ATU-Cs 
utilizes to define or establish logical circuit connectivity, for and ATU-Rs signal each other over the lines to synchronize 
example from any level above ATM all the way up to the L7 their modes of operation at parameter settings, which 
application layer. achieve optimum data throughput. Also, the DSLAM 17 
Returning to the discussion of FIGS. 1 and 2, for purposes 5 do f s not need t0 monitor or limit the line rates, but instead 
of this discussion, assume that the equipment at the various rcucs on tDC rate -adaptive control algorithm to maximize the 
customer premises connect directly to the CO 15 via twisted rates achieved over the ADSL circuits or provide rate- 
pair type copper wiring 21. In an actual implementation, shaping for the ATM virtual circuits. Other network ele- 
many customers may connect through such wiring to a ments limit rates, where necessary. 

remote terminal linked to the CO 15 via optical fiber. Other 10 The L3/4 ATM switch 19 is co-located with the DSLAMs 

hardwired, optical or wireless implementations of the digital 17, within one central office 15. As a result, it is practical to 

subscriber lines are discussed later. In the illustrated connect the multiplexer within each of the DSLAMs 17 over 

embodiment, each line 21 from a customer premises con- a high-speed data link directly to an appropriate port of the 

nects to an ATU-C within one of the DSLAMs 17. ATM switch 19. Because these links are short, there is little 

On the customer premises side, the digital subscriber line 15 or no cost imposed when implementing such links using 

circuit 21 connects to an ADSL terminal unit (remote) or wideband equipment. By itself, the co-location of the L3/4 

ATU-R 23. The ATU-R 23 is a modulator/demodulator ^™ switch 19 with the DSLAM(s) 17 does not increase 

(modem) for communicating over a twisted wire pair type bandwidth. Rather, it makes increased bandwidth at the 

line 21, in accord with the ADSL protocols. The ATU-R in network edge economically feasible, due to proximity, 

turn connects to customer premises equipment, shown by 20 Co-location removes the requirement to purchase expensive 

way of example as a PC 25 at each location (FIGS. 1 and 2). wide area transport (the SONET ring) to increase bandwidth. 

Those skilled in the art will recognize that the customer In particular, me direct OC3/OC12 connections between the 

premises equipment 25 may include a wide range of other DSLAM 17 and the L3/4 ATM switch 19 do not incur any 

types of devices having data communications capabilities recurring tariff expenses. 

(see e.g., FIG. 3). 25 The ATM switch 19 connects through a SONET ring 27 
The ADSL user's normal telephone equipment (not to a gateway router 29 providing ATM transport through a 
shown) also connects to the line 21, either directly or cell relay network 30 (FIG. 2) to the ISPs shown at network 
through a frequency combiner/splitter, which often is incor- H in the drawings. Most of the ISPs will utilize a concen- 
porated in the ATU-R. The normal telephone signals are split trator or other equipment as their point of presence for 
off at both ends of the line and processed in the normal Internet access (FIG. 2). In the preferred embodiment, the 
manner. equipment 31 provides a point-to-point protocol (PPP) inter- 
For digital data communication purposes, the ATU-C and face designed for transport over Ethernet (PPPoE). The ATM 
ATU-R modem units create at least two logical channels in switch 19 ^ provides a connection to the local implemen- 
the frequency spectrum above that used for the normal 35 tation of ^ VSD network 13 > for example via a giga-bit 
telephone traffic. One of these channels is a medium speed Ethernet port to a switch or other local network elements 18. 
duplex channel; the other is a high-speed downstream only The illustrated local access type ADN network 10 pro- 
channel. Such modems may implement either one of two vides ATM cell transport from the customer premises to the 
techniques for dividing the usable bandwidth of the tele- ISP network(s) 11. The ATM cells serve as the layer-2 
phone line to provide these channels. One approach is to 4Q protocol for defining contiguous switched connectivity, 
divide the usable bandwidth of a twisted wire pair telephone Higher level routing protocols, such as Ethernet and TCP/IP 
line by frequency, that is to say by Frequency Division frames, ride within the ATM cells. Services of different types 
Multiplexing (FDM). The other approach uses Echo Can- utilize different protocols at one or more layers above the 
cellation. FDM uses one frequency band for upstream data ATM cell layer. In the preferred embodiments, all commu- 
and another frequency band for downstream data. The 45 nications utilize Ethernet. However, communications to and 
downstream path is then divided by time division multiplex- from the ISPs use the noted PPPoE type Ethernet protocol, 
ing signals into one or more high-speed channels and one or In contrast, communications to and from the vertical ser- 
more low speed channels. The upstream path also may be vices domain use one or more of the other Ethertype 
time-division multiplexed into corresponding low speed protocols. 

channels. With echo Cancellation, the upstream band and 50 To efficiently provide cell relay, each customer is assigned 

downstream band substantially over-lap. The modems sepa- a virtual circuit that extends from the ATU-R 23 in the 

rate the upstream and downstream signals by means of local respective customer premises to the gateway router 29. This 

echo cancellors, in a manner similar to that used in V.32 and logical circuit is defined at the layer-2 protocol level. The 

V.34 modems. present implementations implement this logical communi- 

The DSL modems may use a number of different modu- 55 cation circuit as an ATM permanent virtual circuit, although 

lation techniques to physically transport digital data streams. the inventive concepts may apply to other types of logical 

A number of implementations of the modems have used circuits or channels. 

carrierless amplitude phase (CAP) modulation. Most current The gateway router 29 is the communication node of the 

xDSL modems, however, utilize a discrete multi-tone access network 10 providing access to the wide area IP 

(DMT) approach. 60 packet networks, of corporations or more often of Internet 

Returning to the discussion of the CO 11, the structure and Service providers. The gateway router 29 terminates perma- 

operation of each DSLAM 17 is essentially the same as nent virtual circuits through the cell relay network 30, from 

those of the DSLAM 111 in the embodiment of FIG. 7, the equipment 31 of each such wide area packet network 

except that the control functionality of the DSLAM 17 is provider 11. The gateway router 29 also terminates the 

somewhat different. The DSLAM 17 controls the ATU-Cs to 65 permanent virtual circuits from the subscribers through the 

implement a rate-adaptive ADSL service, to adapt opera- data network 10. For communication with a selected ISP 

tions so as to maximize data rates for the communications network 11, for example, the gateway router 29 routes cells 
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from the permanent virtual circuit from the subscriber the invention. As shown, the network 10 provides a logical 

through to the permanent virtual circuit of the selected ISP "pipe" or circuit 35 extending to the networks 11 of one or 

network 11. In the opposite direction, the gateway router 29 more of the ISPs, for an Internet access application. The 

routes cells from the permanent virtual circuit from the ATM switch 19 (FIG. 1) preferably performs a rate shaping 

selected ISP network 11 through to the permanent virtual 5 °r control function. The leg 35 of the subscriber's traffic 

circuit of the particular subscriber. extending to the ISP 11 provides upstream and downstream 

j~i .t i c t , i *l. * i ' i * •* * j * communication rates conforming to a service level agree- 

f ^ F^°i™ S f^io?, l0glC K l CirC ^' CXtendmg ment (SLA) applicable to the subscriber's Internet access 

from the L3/4 ATM switch 19 through the gateway router application . M SUCQ? the over the subscrib _ 

29 the earner programs one or more nodes along the path ^ logical circuit> cxtending from the switch to the ISP) 

behind the DSLAMs 17, to regulate traffic on the virtual io pf0vide a fifSt kvel of QoS Jo the subscriberj ^ict over 

circuit to the rate corresponding to the grade of Internet the leg 35 appears the same as a subscriber selected grade of 

access service to which the particular customer subscribes. Internet access service as provided by older ADN architec- 

In the preferred embodiment, at least one such node per- tures. FIG. 3 illustrates chat rooms, web surfing and e-mail 

forming this rate shaping function is the L3/4 ATM switch as examples of services an ISP might offer through the 

19. All traffic going to and from the ISP network(s) 11 15 Internet Application SLA circuit 35 and the attendant portion 

therefore is still limited to the rates defined in the service of the subscriber's assigned logical circuit through the 

level agreement (SLA) for Internet access that the carrier has access network. 

with the particular customer. The network 10 also supports communications over one 

The portion of the virtual circuit extending between the or more lo g ical application paths 36 to local applications 37 

ATM switch 19 and the ATU-R 23, however, is not rate 20 hosted in the vertical services domain. Assuming that a 

limited but instead runs at the maximum rate that the line subscriber with various equipment 25 also subscribes or 

will support using the rate-adaptive ADSL modem opera- otherwise participates in one or more of the vertical services, 

tion. In most cases, the rate-adaptive ADSL modem opera- thc local „ camcr ^* g ' ^L. T I I a t 

.„ . ' i_ * *• £ i_- i_ *i_ *i_ i corresponding number of additional application SLAs with 

tion will support rates substantially higher than the subscnp- ^ cu ^ tomer * Each SLA for a vertical service may specify 

tion rate for Internet access service. QoS parameters for the particillar application, such as rate/ 

The 13/4 ATM switch 19 also provides the mterconnec- bandwidth, latency, jitter, packet loss, packet sequence, 

tion to the subscriber's virtual circuit for insertion of down- security and/or availability. Examples of such applications 

stream traffic from the vertical services domain 13 and hosted in the carrier's vertical services domain 37 include 

separation of upstream traffic from the subscriber's virtual 3Q the illustrated voice over IP service shown as a V/IP 

circuit going to the vertical services domain 13. In accord gateway, as well as video services and some caching for high 

with the invention, decisions as to whether upstream traffic volume local web services. Communications for such appli- 

is destined for the vertical services domain 13 or should cations utilize the one or more paths 36. 

remain on the subscriber's virtual circuit going through the ne twork of FIGS. 1 to 3 also supports closed or 

gateway router 29 and the cell relay network 30 to the ISPs 35 privatc uscr work groups or virtual ]ocal arca nctW orks 

11 is based on an analysis of traffic type. The traffic type (VLANs). VLANs, for example, may be implemented as a 

analysis relies on protocol information contained in the service hosted through the vertical services network 13. All 

communications, which relates to layers of the protocol traffic from cust0 mer premises belonging to one of the 

stack that are higher than the layer-2 switching protocol, in VLANs would include a VLAN Ethertype indicator. Since 

this case above the ATM layer. 4Q the frames would not be ppp 0 E type Ethernet frames, the 

As shown in FIG. 2, traffic destined for an ISP 11 utilizes switch 19 would route the upstream transmission to the 

a variation of a point to point protocol (PPP) intended to run vertical services network 13. VLAN frames also carry a 

on top of Ethernet, referred to as PPP over Ethernet or VLAN identifier. The nodes of the network 13 transport the 

"PPPoE/' A Hype' indicator contained within the Ethernet packets for the VLAN members only to resources that are 

frames identifies the PPPoE protocol. In contrast, traffic 45 members of the identified VLAN. In this manner, the 

going to and from the vertical services domain utilizes other capability exists for creating logical workgroups of users 

'types' of Ethernet protocol. All traffic to and from the and their shared resources (servers, printers, etc.), that may 

customer premises uses Ethernet frames carried within ATM be physically separated from each other. VLAN groupings 

cells. can provide privacy and security to their members while 

The switch 19 therefore routes a subscriber* s traffic going 50 enabling "broadcast domains" whereby broadcast traffic is 

to and from an ISP 11, upon detection of the PPPoE indicator kept logically "inside" the VLAN. 

in the level 3 data contained within the Ethernet cells. This The present invention also supports segregation and 
traffic will also utilize public IP addressing. In contrast, the aggregation of traffic for three or more domains, based on 
ATM switch 19 routes a subscriber's traffic going to and the higher-level traffic type analysis. An alternative imple- 
from the vertical services domain, upon detection of any 55 mentation for closed user group services therefore might 
other type of Ethernet protocol at level 3 or above in the actually provide a Ihird domain for such services. PPPoE 
protocol stack. The IP addressing in the vertical services traffic would go to the concentrator equipment 31, as dis- 
domain 13 utilizes private-IP addresses, for example, as cussed above. The switch 19 would route the upstream 
administered with a DHCP server (not shown) coupled to the transmission frames bearing a VLAN Ethertype indicator to 
network cloud 33. Although shown separately, the cloud 33 60 the alternate network serving as the VLAN service domain, 
may be implemented as a portion of the network providing That domain would process VLAN communications essen- 
the physical elements of the vertical services domain. The tially as done in a normal switched Ethernet type network, 
portion 33, however, would typically be a logically separate Upstream transmissions that bear any other type of Ether- 
domain that the carrier controls and restricts for its own type indicator would go to the vertical services network 13, 
network administration use. 6 $ as in the earlier examples. 

FIG. 3 depicts the logical division of the subscriber's A feature of the switch, in accord with the invention, is 

traffic, as implemented at the ATM switch 19 in accord with that it prioritizes traffic for each customer to support QoS for 
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the various services as required by service level agreements 
(SLAs) between the customer and the carrier. In this regard, 
one implementation of the L3/4 ATM switch 19 performs 
queuing and tagging operations in accord with the desired 
prioritization. The switch will maintain two or more queues 5 
for each subscriber's permanent virtual circuit. The switch 
distinguishes the queues based on importance or priority. As 
the switch receives cell transmissions for transport over the 
virtual circuit to the customer premises, the switch will 
internally tag each cell as to its importance level and place 10 
each cell in the appropriate queue based on the tag. 

The tagging and prioritization may be based on traffic type 
or 'Type of Service * (ToS). Table 1 illustrates one example 
of the possible ToS levels that may be assigned to different 
communications. 
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tion device based rules) obtain access to the limited rate 
adaptive bandwidth available on any given subscriber's line. 
Also, the insertion point, switch 19, will usually sit behind 
the media conversion point (e.g., the DSLAM 17). An OC3 
or other facility between the switch 19 and the DSLAM 17 
also could become congested. Preferably, the switch 19 or 
other element at the insertion point queues the traffic in such 
a manner that no downstream facility (OC3) limitations 
(which are independent of the rate adaptive DSL loop 
limitations) will result in packets being dropped. 

The queuing will be done based on customer and network 
provider determined rules so that contention for the facilities 
facing the subscriber will be addressed via the dropping of 
the appropriate packets. That way an inserted video stream 
doesn't overwhelm a PPPoE or Voice stream (due to facility 



TABLE 1 



Relative 


ToS 




Customer Traffic 


Internal BA Mgmt Traffic 


Priority 


Value 


AR Queuing 


Encapsulated TOS 


Rewritten TOS 


Critical 


0 


WFQ 




OSPF, SNMP, 


Management 




(Control 25%) 




ICMP,BGP 


Future 


1 








Real Time 


2 


WFQ 


Port numbers identified 




Interactive 




(High 40%) 






IP 


3 


WFQ 


ICMP, IGMP, EGP, DNS, H.323 


IGMP, RADIUS 


Application 




(Medium 


signaling, BGP, SIP, Microsoft 




Control 




30%) 


Media Player Streaming Media 
Control, RTSP 




One Way 


4 




UDP (ports 1024+) 




Streaming 










Media 










One Way 


5 




HTTP, HTTPS, SNMP, Telnet 




Batch 










Unknown 


6 


WFQ 
(Low 5%) 


Other 


Other 


Non time 


7 




FTP, TFTP, SMTP 




sensitive 











The access switch 19 will examine the content of each 
communication and determine an appropriate ToS level, for 4Q 
example in accord with the table above. Based on the ToS 
level, the switch will add a tag to the cell(s) as part of its 
internal processing. Using the ToS tags, the switch will place 
each of the cells for a given subscriber into a corresponding 
one of a plurality of queues that the switch maintains for the 45 
subscriber's traffic. 

The switch may implement any one of a number of 
different queue servicing algorithms to select and transmit 
cells from the various queues. For example, the switch 19 
may implement one of several statistical algorithms, equal 50 
queuing, weighted queuing, priority selection from queues, 
etc. The particular algorithm is selected to implement QoS 
in conformance with the subscriber's service level agree- 
ments (SLAs) with the carrier. In most cases, particularly for 
service applications from the vertical services domain, the 55 
switch 19 will not normally drop any cells or packets. In the 
rare event that the switch 19 becomes congested, any 
dropping of cells is based on the priority level assigned to 
the frame, i.e., lowest priority first. Also, if the switch ever 
drops cells, it drops all cells for an effected lowest priority 6(i 
frame from the relevant queue. 

The ability to prioritize traffic across the inserted streams 
and the PPPoE stream enables the operator to control flows 
through the ADN 10 so that the local access facility is not 
overwhelmed with content which exceeds its physical (rate 65 
adaptive) limitations. For example, the queuing rules pref- 
erably ensure that the 'proper' applications (based on inser- 



limitations). Among others, appropriate industry understood 
methods for accomplishing this queuing control include 
Weighted Fair Queuing (WFQ), Priority (PQ) Queuing, and 
Weighted Random Early Discard (WRED). 

Also, the ability of the switch 19 to examine higher level 
information provides other advantages in network opera- 
tions. For example, the switch can implement sophisticated 
filters on the higher level information, e.g., to provide 
security. As another example; the switch preferably performs 
measuring and monitoring to determine what if any packets 
get dropped (based on the physical rate adaptive 
limitations), and generates appropriate reports to an external 
operations system (not shown). 

The introduction of the L3/4 ATM switch 19 in proximity 
to the DSLAM(s) 17 also provides benefits in terms of 
operation of the gateway router 29. Due to the end-to-end 
use of the Unspecified Bit Rate (UBR) PVCs, the gateway 
router interface to the cell relay network 30 has been 
engineered to support a maximum of 2000-4000 PVCs (end 
users). This is essentially an over-provisioning of bandwidth 
that probabilistically avoids service degradation that could 
result from simultaneous demand for bandwidth. The ability 
of the L3/4 ATM switch 19 to perform QoS and rate shaping 
essentially reduces or ever removes this concern, because it 
significantly reduces the risk that the gateway router 29 will 
become a bottleneck. As a result, the ADN 10 can increase 
bandwidth efficiencies for this interface. Further, the capac- 
ity through the gateway router 29 need not be upgraded as 
often to support demand for increased bandwidth associated 
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with new bandwidth-intensive services, since many such 
services are now introduced through the vertical services 
domain 13 and the L3/4 ATM switch 19. 

To fully understand an exemplary implementation of the 
various inventive concepts, it may be helpful to consider an 5 
ATM-based embodiment of the L3/4 switch 19. FIG. 4 is a 
block diagram of the elements and functions of such a 
preferred embodiment of the switch 19. 

The preferred embodiments utilize Ethernet framing. As 
shown in the drawing, the switch 19 includes an Ethernet 10 
interface 41, an ATM interface 42 and an associated physical 
interface 43 facing toward the subscribers. In an embodi- 
ment for use in the network of FIGS. 1 and 2, the physical 
interface might take the form of one or more OC-3 or OC-12 
links to the DSLAMs 17. These links carry all ATM cell 15 
traffic going to and from the DSLAMs and hence to and 
from the customer equipment served through the particular 
switch 19. 

The switch 19 also includes an Ethernet interface 44. an 
ATM interface 45 and associated physical interface 46 
facing toward the gateway router 29 and hence the ISPs 11. 
The physical interface 46 might take the form of one or more 
OC-12 or OC-48 links to the gateway router 29. These links 
carry all ATM cell traffic going to and from the ISPs or other 
wide area inter-networks 11. For these communications, the 
Ethernet interface 44 passes through PPPoE traffic, as speci- 
fied by the Ethertype indicator in the cells transporting the 
relevant frame segments. 

Facing the vertical services domain, the switch 19 3Q 
includes an Ethernet interface 47 and a physical interface 48. 
These interfaces conform to the particular network utilized 
by the carrier for the vertical services domain, such as 
giga-bit Ethernet over wire or optical links. 

The switch fabric 49 performs the physical switching of 3S 
data along various paths through the switch 19, in response 
to instructions from a programmed routing controller 50. 
FIG. 4 also shows the communications flow through the 
switch, for each subscriber. The switch 19 also implements 
a Decision Point 51, shown for example within the Ethernet 40 
interface processing 41 on the subscriber facing side. At that 
point, the PPPoE traffic is separated from all other traffic. 
From that point, the PPPoE Flow 52 for each subscriber 
extends as a portion of the subscriber's ATM virtual circuit, 
facing the cell relay network and hence the ISPs 11. The 45 
PPPoE Flow 52 contains Ethernet frames that are of PPPoE 
Ethertype. Facing towards the subscriber premises, the 
switch 19 implements an Aggregate Flow path 53, in the 
form of another portion of the ATM virtual circuit, which 
contains all ingress/egress subscriber traffic. The switch 50 
implements a Generic Path 54 extending through the inter- 
faces to the vertical services network. This path 54 carries all 
traffic other than PPPoE. 

In this example, the switch 19 implements the Decision 
Point 51 based on recognition of the Ethertype indicator, ss 
which is above the layer-2 ATM cell routing information. 
However, the switch may implement the Decision Point 51 
based on still higher-level protocol information. 

In a preferred embodiment, the Ethernet and ATM inter- 
faces 41 and 42 and the Ethernet and ATM interfaces 44 and 60 
45 implement segmentation and reassemble (SAR) 
functions, essentially providing two-way conversions 
between ATM cell format and Ethernet frame format. Seg- 
mentation involves dividing an Ethernet frame into a num- 
ber of 48 -byte blocks and adding ATM headers to the blocks 65 
to form a corresponding number of ATM cells. Any blocks 
that do not include a complete 48 -byte payload are padded 



as necessary. Reassembly entails receiving and buffering 
ATM cells until it is recognized that a complete frame has 
been received. The ATM headers of the cells and any 
padding are stripped, and the payload data is reassembled 
into the form of an Ethernet frame. 

In such an embodiment of the switch 19, the decision 
point 51 determines how to selectively forward the Ethernet 
frame information taken from a particular series of upstream 
ATM cells based on the Ethernet information taken from the 
ATM cell payloads, for example, by examining the frame 
header and recognizing the particular Ethertype indicator. 
Internally, the actual switch fabric 49 for such an embodi- 
ment of the switch 19 would comprise an Ethernet switch, 
even though to other elements of the ADN network 10 the 
switch 19 appears to perform an ATM switching function. 

Those skilled in the art will recognize however, that the 
decision and switch fabric may be implemented in other 
ways. For example, a series of cells corresponding to an 
Ethernet frame could be buffered and the payloads examined 
just to recognize and identify the Ethertype indicator, with- 
out a complete reassemble of the Ethernet frame. This later 
implementation therefore could utilize an ATM cell-based 
switch fabric. 

From the discussion above, it should already be apparent 
that certain aspects of the invention relate to setting up 
logical communication circuits at a relatively low protocol 
layer corresponding to switching or routing functions and 
then segregating traffic by distinguishing communication 
type using higher level protocol information. To insure full 
understanding on these points, it may be helpful to consider 
the protocol layer definitions, with particular reference to the 
illustration of the preferred layers in FIG. 2. The Interna- 
tional Standards Organization (ISO) Open Systems Inter- 
connection (OSI) reference model specifies a hierarchy of 
protocol layers and defines the function of each layer in the 
network. 

The lowest layer defined by the OSI model is the physical 
layer (LI). This layer provides transmission of raw data bits 
over the physical communication channel through the par- 
ticular network. For example, on the subscriber lines in the 
preferred embodiment, the physical layer (LI) uses ADSL. 
Within the customer premises, communications use an Eth- 
ernet physical layer (LI), such as lOBase-T. Upstream 
network elements may use DS3 at some points, but most use 
SONET, for example OC-3 or OC-12 physical layer trans- 
port. Attention is directed to the lower half of the diagram in 
FIG. 2, which depicts the various protocol stacks throughout 
the network 10. 

The layer defined by the OSI model next to the physical 
layer is the data link layer (L2). The data link layer trans- 
forms the physical layer, which interfaces directly with the 
channel medium, into a communication link that appears 
error-free to the next layer above, known as the network 
layer (L3). The data link layer performs such functions as 
structuring data into packets or frames, and attaching control 
information to the packets or frames, such as checksums for 
error detection, and packet numbers. In the network 10, the 
data link layer (L2) is used to define certain switching 
functions through the network. The network layer (L3) 
provides capabilities required to control connections 
between end systems through the network, e.g., set-up and 
tear-down of connections. 

The preferred embodiments utilize ATM cell transport as 
the lowest element of the data link layer (L2), for example 
to define the connectivity extending from the ATU-Rs 23 
through the ADN network 10 to the ISP or corporate 
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networks 11. Subscriber virtual circuits are provisioned at tions services through the ADN network 10, the discrimi- 

the ATM cell layer, that is to say at the data link layer (L2). nation based on Ethernet actually implements a decision 

Similarly ISP virtual circuits are provisioned at this ATM based on an effectively higher protocol layer, 

data link layer (U£ ftom the gateway router 29 through the Jp col carries the actual higher . level applications 

?™ y , nCt T?K f t0 I. sp 1 i ^~!« nt " toI ? 31 - ™ e s information, for transport to and from the vertical services 

ATM protocol therefore is the layer-2 (L2) protocol used to A Jr. - . j c *u • j 

• r% iL. i ■ i ,> £ ,« l *i_ * domain and for transport to and from the wide area mter- 

define the logical connectivity from the subscnber premises 4 1A . T r» j i * j ^ ^ . i 

to the gateway router 29. The ATM protocol also is the ne f two ** M s * ch ; * P and lts rc ^ ated ra f p0rt 

layer-2 (L2) protocol used to define the logical connectivity re { erred t0 * * e Transmission Control Protocol' (TCP) 

from the gateway router 29 to the ISP concentrators 31. in " de 1 on to P °f <f e encapsulated within) the lower 

„ i- • u * l. i i i i 10 level protocol elements discussed above. Presentation and 

For purposes or this discussion, higher level protocols are *\. « , ., 4 r lL Tr , , ,~ 

* i *u ♦ -j i , j , u application layer elements ride on top of the IP layer. IP 

protocols that nde on or are encapsulated within the par- rr . , v , , J 

f. < , - . , . . . r . i j / . communication requires that each user device have an 

ticular layer-2 protocol, that is to say in the payloads of the jthjj ttijj u 

Arr ., „ . 4 [ c j . i o « « ■ . , ! assigned IP address. IP addresses, however, are a scarce 

ATM cells in the preferred embodiment. Such higher level <■* n fiL nn, i .t j 

i ■ i j * 1 u - u j commodity. Because oi the use of IP transport for both wide 

protocols include some protocols, which are orten consid- 1C . , t . . , r lL , 

j 4 . ! .ufi^ ii i_ iL 35 area services and vertical domain services, the network 10 

ered themselves to be level-2 protocols, where they are , « t J<ir ; ™ , , 

. i . « „5 r j i j ■ . actually may at times assign two different IP addresses to 

transported within ATM cells. The preferred embodiments . \. i . • *• j • * a iu 

*1. JT i i . i , iL A ™* each active data communication device of an end-user, albeit 

use Ethernet, a local area network protocol above the ATM , « • t*l * j • . • . 

^ «u t t i i-p i ■ « 4l _ . i . ! on a temporary basis. Ine wide area communications and 

portion of the L2 layer. Technically, the Ethernet protocol .u i • i i u • j 

r , . j j iL T - /' . i tt the vertical services network may also be viewed as two 

may be considered as another L2 layer protocol. However, on 4 , „ - 7 

, ' . * j j i ~» » , .« i j separate broadcast domains, 

because it is segmented and encapsulated into the payloads r 

of the ATM cells, the Ethernet protocol information actually First > the carrier operating the ADSL data network 10 and 

is a higher level protocol information above the specific the vertical services domain network 13 wUl maintain a pool 

level-2 protocol (ATM) that defines the normal connectivity of local addresses for assignment, on an as-needed basis, to 

through the ADN network 10. end user equipment 25. To the carrier, the available IP 

In the OSI model, a transport layer protocol (L4) runs addresses are a limited resource. Accordingly, the carrier 

above the network layer. Hie transport layer provides con- ass1 ^ IP addresses on a dynamic basis, only to those users 

trol of data transfer between end systems. Above the trans- actually on-line at any given time The carrier preferably 

port layer, a session layer (L5) is responsible for establishing u ^ lzes P nvate ° etv ™ rk ^ IP addresses and dynamically 

and managing communication between presentation entities. 30 administers such addresses usmg dynamic host configura- 

For example, the session layer determines which entity !i° n Jjf OCO j (DHCP) * ? H U CP * a p ? loco1 automatic 

communicates at a given time and establishes any necessary TCP/1P configuration, which enables dynamic address allo- 

synchronization between the entities. Above the session catlon and management. 

layer, a presentation layer (L6) serves to represent informa- When a particular device 25 becomes active via the 
tion transferred between applications in a manner that pre- 35 ATU-R 23 and the DSLAM 17, it will activate a basic 
serves its meaning (semantics) while resolving differences in protocol stack, including an IP portion enabling communi- 
the actual representation (syntax). A protocol (L7) that is cation with a DHCP server. The device will transmit an 
specific to the actual application that utilizes the information address request upstream through the network on the sub- 
communicated runs at the top of the protocol stack. scriber's virtual circuit. At the Ethernet level, this transmis- 

In accord with one inventive concept the network 10 4 o sion appears as a broadcast message. The U/4 ATM switch 

actually utilizes two or more different types of protocol at 19 > however, will recognize that the packet is not a PPPoE 

levels above the protocol within the L2 layer that actuaUy communication and route the cells carrying the packet into 

defines the network connectivity. The ADN network 10 may the vertical services doma in ™ Typically, a DHCP server is 

use different protocols at the higher layers as well. By coupled to the vertical services domain network 13, for 

distinguishing transmissions based on differences in these 45 exa mple as part of the carrier's administrative network or 

higher-level protocol types, the ATM switch 19 separately systems 33. The DHCP server somewhere on the vertical 

forwards different types of communication traffic for each services domain 13, 33 will answer that broadcast request by 

subscriber. In the preferred embodiment, communications to selecting and providing an available one of the private IP 

and from the ISP or corporate networks 11 utilize point-to- addresses from the carrier's pool of available addresses. The 

point protocol (PPP) as the network layer (L3) protocol and 50 messa g e with the assigned address will go back to the L3/4 

a shim for transport of PPP over Ethernet (PPPoE). PPPoE, A ™ swltch 19 for insertion into the virtual circuit and 

as one Ethertype protocol could also be considered as a transport back to the requesting device 25. 

second layer (L2) protocol albeit above the Ethernet layer The particular end-user's device 25 uses the assigned 

itself, which in turn rides on the ATM cells used for routing private IP address as its source address, for all of its 

at least through the permanent virtual circuit at the L2 layer. 55 communications with the vertical services network 13, so 

In the illustrated implementation, however, the use of the lon S as il remains on-line for the present session. When the 
PPPoE or a different protocol actually is an indication of a overall session ends and the end-user device 25 goes corn- 
difference in type of the higher layer protocols. In the pletely off-line, the DHCP server returns the private IP 
illustrated example of FIG. 2, the vertical services domain address to its pool of available addresses, for reassignment 
traffic utilizes Ethernet (802.3 SNAP) above the ATM adap- 60 to another user as the next user comes on-line, 
tation layer (AAL). As noted, the presently preferred L3/4 As noted, the user equipment 25 receives a private IP 
switch 19 implements its routing decision based on recog- address from the DHCP server. The addresses of services on 
nition of the Ethertype indicator, that is to say to distinguish the vertical services domain also are private IP networks, 
the PPPoE traffic from all other types of transmission from Because these addresses are private, they are accessible only 
the customers' data equipment. In view of the use of ATM 65 to equipment within that domain and the data network 10. 
as the data link layer (L2) protocol of the network defining Consequently, the devices are not accessible to hackers or 
the lowest layer of network connectivity for communica- the like coming in through the public Internet. 



04/15/2004, EAST version: 1.4.1 



US 6,424,657 Bl 

23 24 

This dynamic assignment of IP addresses allows the address request. The switch 19 also limits transport of 

carrier to limit the number of IP addresses used to the non-PPPoE broadcast messages to the vertical services 

number of users actively connected through the ISP's host to domain network 131, both for the address request message 

the Internet. The use of private IP addresses allows the user and for other types of broadcast requests. As such, the 

equipment to communicate with the vertical services domaio s logical circuit to the PPPoE concentrator 31 becomes the 

utilizing a normal IP-Ethernet protocol stack. conduit to one broadcast domain for upstream PPPoE mes- 

For the as-desired Internet access service, for example sages; and the vertical services network 13 defines a second 

using a PPP or similar protocol, IP addresses are adminis- broadcast domain for upstream messages of other Ether- 

tered through the ISPs. The PPPoE protocol preserves or 10 types, 
emulates the traditional dial-up approach to ISP access. 

However, the PPPoE approach does utilize Ethernet and In addition 10 vertical semces > to carner continues to 

follows Ethernet standards, for example, involving process- provide agreed access services to the equipment of the ISPs, 

ing of certain broadcast messages. in a manner analogous to current practices. For example, the 

The user can select an ISP of choice, and her data 15 carrier may provide its Internet access service to a subscriber 

equipment 25 will initiate a selective session through the on a monlhl y subscription basis, at one of several available 

Ethernet layer on the network 10 to access the equipment 31 rates corresponding to the grade of Internet access service 

of the selected ISP network 11, in a manner directly analo- ( and thus the rate of communication to/from the ISP) 

gous to a dial-up modem call through an ordinary telephone 20 selected by the customer's subscription, 

network. Hence at a time after initial activation through the i n an erjQanced service offering, the broadcast provider 

networks 10 and 13, the user may activate a browser or other CQuld offef a convenient Qavigation ^face from a web 

program for using the wide area internetwork service. This ^ ^ ^ ^ fae Qn ^ yertical sfirvices 

activates a second protocol stack, which includes the PPP ^ ^ ^ ^ on ^ ^ ^ u ^ a pppoE 

protocol and the PPPoE shim. The user selects an ISP, and 4 . C4 t , , , 

\ . ... , ' session active, the user can surf to the provider s server and 

the data equipment initiates communication through the . „ , „ , , m 

^ 1 n,\ nm r • . n c *u . ic-n view mformation about available programming. The user 

network 10 to the PPPoE equipment 31 of that ISP. . , t , ( 

might select a current broadcast program by clicking on a 

The IP addresses used by each ISP are public network T1DT . , . . A . e A1+u , 

, , _ , , ' , , „ \ t m URLlink in the provider s web -based information. Although 

type IP addresses. To the ISP, the pool of available public IP 30 , . * _ M1 4 , T1 „ T 

. . A i . j. i L m n provided through the wide area Internet 11, the URL would 

addresses also is a limited resource. Accordingly, each ISP , „ t ° iL . 4 TT1 , , e it _ , . , 

„ . tn j, , . l • 1 * actually contain the private IP address for the desired 

prefers to assign IP addresses on a dynamic basis, only to , ■ , , , . , 

7, : „ . , . m * -.-I broadcast program available from the vertical services net- 

those users actually on-line at any given time. Typically, as . * , TmT , , 

A - c ™™ • ,1. work 13. Selection of such a URL therefore would generate 

part of each initial access operation for a PPPoE session, the . c , . , . , . 

, , j .i nnn t . . « J5 a message to the appropriate server on the vertical services 

user s equipment 25 and the PPP terminating equipment 31 . fr , 

r it ror. . , , , , • 4 . u j . network 11 to initiate the above discussed procedure to 

of the ISP conduct a handshaking, to establish data com- „ . , . , , j . * • ., 

. . . i_i a. p » j . iL allow the user to join the selected broadcast. A similar 

mumcations therebetween. As part or this operation, the , « t . , , , t . ^ „ 

, , . « j * 4 r Li- in methodology might also enable a provider to offer menu, 

user s device transmits a broadcast request for a public IP , . « 7 c , T « 

i ^ i_ j * r>r>r> r t u u *u selection and order/billing services from the Internet 11, to 

network. The broadcast message, in PPPoE goes through the 40 » 

... . , 4 4 - A - \_ provide pay-per-view or video on-demand type services 

virtual circuit to the gateway router 29 and through the * , . , . 

j ii | . , int Ten nnn c * fr° m tne vertical services domam network 13. 
router and cell relay network 30 to the ISPs PPPoE equip- 
ment 31. Although it is a broadcast message, the network Although IP-based, the services from the vertical services 
effectively limits transport thereof to the virtual circuit going ^ domain 13 may follow any other desirable business model, 
to the ISPs PPPoE equipment 31, that is to a domaio separate For example, a multicast service provider may contract with 
from the vertical services network domain 13. the carrier to provide multicast audio (radio-like) and/or 
The ISP host equipment 31 initiates a procedure to assign video (TV-like) services via the vertical services domain, 
the user's computer 25 a numeric Internet Protocol (IP) The multicast service provider, not the subscribers, would 
address from the pool of available public addresses and 50 pay the carrier. The multicast service provider may offer any 
sends a PPPoE message containing that address back to the or a11 of tne multicast programming to customers on some 
subscriber's device 25. When the session ends and the user type pay-per-view basis but would likely offer most of the 
goes off-line, the ISP host can reassign the address to another programming service for free or bundled in as part of some 
user, as the next user comes on-line. 55 nominal monthly subscription charge. The multicast service 
This dynamic assignment of IP addresses allows the ISP P rovider instead would char S e adv ^isers in a manner 
to limit the number of public IP addresses used to the analogous to current broadcast business practices. Advertis- 
numberofusersactivelyconnectedthroughthelSPshostto in S d ^buted with the IP multicasting, however, can be 
the Internet. The end-user equipment will implement a carcfull y tai S ctcd at <* d -™*mers having demographic 
second protocol stack, carrying PPPoE communications. «° P rofiles meetin S s P ecific criteria s P ecified b V individual 
The PPP protocol will allow the end-user equipment to adv ertisers, which allows the multicast service provider to 
obtain and utilize the public IP address for communications char S e P reraiura advertising rates. 

going to and from the public internetwork. Table 2 summarizes the characteristics and requirements 

The switch 19 will limit transport of other types of PPPoE 65 of a number of examples of the types of vertical services that 

broadcast messages to the link to the PPPoE concentrator 31, the VSD network 13 can deliver via the L3/4 ATM switch 19 

in a manner similar to that described above for the PPPoE and the ADSL data network 10. 
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TABLE 2 



Vertical Service 
Offering 



Characteristics of the Service 



Network Requirements 



Nfoice Services 



Video On Demand 
(Unicast) 



Multimedia Broadcast 
(Multicast) 
Caching Services 



Distance Learning 
(EVC) 

Telecommuting 



Local Co-Located VoIP Gateways, VoIP, 
Unified messaging, IP PBX, IP Centrex 

Local VOD Servers or access to centralized 
servers. 

Supports whatever model of server 
deployment/content delivery mechanism 
Broadcast Video; Broadcast Audio; Satellite 
Down Link support; Local Servers at the edge. 
Local servers at the insertion point, Local 
delivery mechanism for generic media objects 
such as web pages, images, video files, audio 
clips, software downloads, etc. 
Integrated interactive video, voice and data 



Closed user group with access to Transparent 
LAN Service (TLS). 



Low latency, low jitter, uon- 
correlated packet loss, and high 
availability 

High bandwidth, low jitter, high 
availability, and low packet loss 



Varies with content type and with 
multicast implementation 
Layer 3/4 visibility 



Low latency, low jitter, non- 
correlated packet loss, and high 
availability 
IEEE 802.IQ 



One alternative arrangement, to that of FIG. 1, for pro- 
viding DSLAM functionality is illustrated in FIG. 5. This 
arrangement locates a remote terminal DSLAM 
(RTDSLAM) 502 downstream from the central office (CO) 
504, typically via an OC-12 link 506. The RTDSLAM 502 
communicates with subscribers over xDSL links 510, 511 
and 512. The links 510, 511 and 512 can be any of a variety 
of DSL services such as SDSL, HDSL, VDSL and ADSL, 
similar to those provided by the central office DSLAM in the 
earlier embodiment. 

As illustrated in FIG. 5, more than one RTDSLAM 502 
and 532 can communicate with a central DSLAM 534 in the 
CO 504, with each RTDSLAM servicing a number of 
different subscribers. In alternate embodiments, the central 
DSLAM 534 and intermediate link 540 can be omitted such 
that the RTDSLAMs 502 and 532 interface directly with a 
switch 536 in the central office 504 via links 506 and 546. 

The downstream traffic from one or more Internet Service 
Providers (ISP) 555 over virtual circuits 550-553 are aggre- 
gated by the switch 536 over physical links 540 and 506 and 
are forwarded to and through the DSLAM 502. Each virtual 
circuit is typically limited to the rates defined in any SLAs 
that the carrier has with a particular customer. However, the 
RTDSLAM 502 can still become overburdened with traffic 
from all its associated virtual circuits even when each virtual 
circuit is within its individual limit. In such instances, the 
RTDSLAM 502 handles downstream traffic on a first come, 
first served basis resulting in some discarding of traffic for 
a virtual circuit that did not exceed its SLA limit. This 
method of discarding traffic effectively places all the traffic 
within, and among, the different PVCs at the same priority 
level with no guaranteed service quality relative to other 
PVC traffic arriving at the DSLAM. 

By allowing the different virtual circuits through the 
RTDSLAM 502 to have assignable priority levels in relatiorj 
to each other or by allowing the different types of traffic 
within a particular virtual circuit to have assignable priority 
levels, the invention provides a structured approach to how 
traffic is forwarded to a potentially overburdened RTD- 
SLAM. As a result, different tiers of service can be guaran- 
teed for downstream traffic through an RTDSLAM. 

FIG. 6A illustrates a detailed view of a portion of the ADN 
between the VSI switch 536 and the subscriber's equipment, 
in which an RTDSLAM 502 is used for connecting to the 
subscriber equipment 690, 691 and 692. 



Three permanent virtual circuits (PVCs) 602, 604 and 606 
are illustrated in FIG. 6 A, with each PVC carrying the 

25 communications between a subscriber and their ISP. As 
illustrated, two of the PVCs 602 and 604 connect to the same 
ISP 1 and may be physically carried on the same DS-3 link 
610, for example. The other PVC 606 can connect to a 
different ISP 2 also via a DS-3, or other, link 612. 

30 As previously described, the downstream traffic in the 
PVCs 602, 604 and 606 is switched through the VSI switch 
536 and forwarded to a central DSLAM 616. The down- 
stream ISP traffic is also combined, as needed, with data 
from the vertical services domain 620 by inserting, at the 

35 switch 536 any vertical services data into the appropriate 
PVC 602, 604 and 606. From the central DSLAM 616, the 
PVCs 602 , 604 and 606 are aggregated over a high-speed 
link 506 and sent to the RTDSLAM 502. From the RTD- 
SLAM 502, each PVC 602, 604 and 606 is carried to a 

4Q> subscriber 690, 691 and 692 over an xDSL link. 

As described in relation to providing QoS for the data 
from the vertical services domain, the switch 536 includes 
multiple sets of queues 632, 634 and 636 for each PVC 602, 
604, and 636, respectively. Each set of queues 632, 634 and 

45 636 are shown as having four separate queues in order to 
maintain consistency with previously described queue struc- 
tures and corresponding types of service. As noted in that 
previous discussion, having four different queues is merely 
an exemplary structure and other numbers of queues can 

50 also be implemented. 

As previously noted, the presence of the queue sets 632, 
634 and 636 provides a way to prioritize downstream traffic 
within a PVC arriving at the switch 536 from the vertical 
services domain 620. In addition, these queue sets 632, 634 

55 and 636 can be used to provide a method of prioritizing 
downstream traffic within a PVC arriving at the switch 536 
from an ISP. 

A subscriber, for example 690, may want to ensure his 
downstream traffic has a relatively higher priority than other 

60 subscribers* downstream traffic that is also passing through 
the RTDSLAM 502. Alternatively, or in conjunction, the 
subscriber 690 may be a business that places more impor- 
tance on data services from the ISP than video services from 
the ISP, or from the vertical services domain 620, and may, 

65 therefore, want to prioritize data traffic accordingly. Other 
subscribers can have different priorities in relation to the 
various voice, data, and video services being delivered from 
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their ISPs and the vertical services domain. By controlling 
the manner in which downstream data from the ISP within 
a particular PVC, and among different PVCs, is queued in 
the switch 536, different grades of service, or tiers of quality, 
can be offered to subscribers. 5 

Similar to the prioritizing of vertical services data into 
Control/High/Medium/low queues, as described earlier in 
relation to Table 1, downstream traffic in a PVC 602 from an 
ISP can be prioritized into the different queues according to 
agreed upon service levels associated with different types of 10 
traffic coming from the ISP. Preferably, the prioritization is 
based on information from protocol layers above the layer 2 
protocol defining the switched connectivity through the 
network (e.g., in this embodiment, above the ATM cell 
layer). Based on the type of traffic in particular cells or 
frames within PVC 602 and an agreed upon prioritization 15 
rule-set for that subscriber 690, downstream ISP traffic 
within the PVC 602 is appropriately distributed among the 
four queues 632. In normal operation, a complete respective 
frame containing data from all the cells transporting that 
frame, is placed in the appropriate ingress queue as it is 20 
received, and the switch reads data from the ingress queue 
to move the frame (i.e., all the corresponding cells) to the 
appropriate egress queue. 

However, unlike the typical Ethernet traffic received from 
the vertical services domain 620, the traffic arriving at the 25 
switch 536 from an ISP is typically ATM cells which the 
switch 536 re-assembles into Ethernet frames. As ATM cells, 
the traffic type (e.g., video, data, voice etc.) of the arriving 
traffic is difficult to determine and, therefore, makes priori- 
tizing the traffic based on traffic type just as difficult. 30 
Accordingly, the switch 536 can re-assemble the arriving 
cells into higher-level frames and packets, for example layer 
3 or layer 4 packets, so that the traffic type can be easily 
identified and prioritization of the cells into the different 
queues can be accomplished at the frame level. This 35 
re-assembly into higher level frames can be semi-permanent 
so that the frame is switched through the switch fabric of the 
switch 536 as the higher level frame and then disassembled 
into ATM cells before being transmitted from the switch's 
downstream side. Alternatively, this re-assembly could be 4 q 
temporary and only to the extent needed to identify the 
appropriate upper-layer information; and the switch 536, 
therefore, would be configured to queue and switch ATM 
cells through its fabric. 

As just described, the downstream ISP traffic within a 45 
particular PVC can be examined at a higher protocol level 
and prioritized based on a queuing strategy in accordance 
with a selected grade of service for different traffic types 
within that PVC. However, the queues 632, 634 and 636 do 
not accomplish prioritizing traffic among different PVCs. 50 

A queuing structure with two tiers can be used to provide 
prioritization between the different PVCs 602, 604 and 606. 
The first tier comprises the queue sets 632, 634 and 636 for 
the individual subscriber PVCs. The second tier comprises a 
queue set 652 of prioritized queues for the link from the 55 
switch 536 to the RTDSLAM 502. The second tier queue 
652 receives cells from the individual PVC queues 632, 634 
and 636. In a preferred embodiment, the queue 652 also has 
a four-queue structure that is serviced according to any of 
the many conventional methods, as described earlier, based 60 
on the capacity of the downstream facility. For ease of 
reference, the queues 632, 634 and 636 can be referred to as 
ingress queues and the queue 652 can be referred to as the 
egress queue. The prioritization of traffic between the dif- 
ferent PVCs 602, 604 and 606 is accomplished according to 65 
how the ingress queues 632, 634, and 636 are serviced in 
order to populate the egress queue 652. 
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A preferred method for servicing the ingress queues, is to 
utilize access control lists (ACLs) that depend on a specified 
tier of service for a PVC in relation to other PVCs passing 
through the same RTDSLAM. An ACL is considered to be 
a rule-set that describes how queue entries from a particular 
PVCs ingress queue set (for example 632) are forwarded to 
the egress queue 652. An exemplary ACL, therefore, would 
identify those PVCs 602, 604 and 606 that utilize the same 
RTDSLAM 502 and a relative level of quality associated 
with each of those PVCs and/or the specific services within 
the PVCs. In one embodiment, using predetermined knowl- 
edge regarding the likely capacity of the RTDSLAM 502, 
the switch 536 would service each of the ingress queue sets 
632, 634 and 636 based on the relative priorities as indicated 
by the ACL, in order to populate the egress queue 652. As 
a result of this two-tier queue structure, prioritization of 
downstream traffic can be accomplished not only within a 
PVC but also between different PVCs. 

The rate of servicing the egress queue 652 can be regu- 
lated so as to limit the downstream traffic to a capacity that 
a downstream RTDSLAM can handle. Within the RTD- 
SLAM there are buffers which handle one or more PVCs 
going to one or more CPE devices. The switch 536 is able 
to automatically determine, or is programmed with infor- 
mation relating to, a buffer size associated with each PVC in 
the RTDSLAM. The servicing algorithms for the ingress 
queues 632, 634 and 636 and egress queues 652 are per- 
formed by the switch 536 so as not to exceed the buffer 
capacity of a buffer in the RTDSLAM. By limiting the traffic 
in this manner the number of cells dropped by the RTD- 
SLAM can be reduced. A greater benefit, however, is that if 
cells need to be dropped, then the selection of dropped cells 
can effectively be performed at the switch based on relative 
priority of the cells. Furthermore, because the switch can 
view data in the context of frames, as opposed to just cells, 
reduction in the number of cells passing through an RTD- 
SLAM can be accomplished by the switch dropping a single 
frame of multiple cells rather than the RTDSLAM randomly 
dropping a cell from a number of different frames. Random 
cell loss randomizes the impact on larger, multi-cell frames. 
Dropping even a single cell from a frame typically results in 
loss and retransmission of the whole frame; accordingly, 
even though downstream traffic may be limited (i.e., shaped) 
by the switch in the present invention, the actual throughput 
through the RTDSLAM is improved by reducing the random 
nature in which cells are dropped and frames retransmitted 
at the RTDSLAM. 

FIG. 6B illustrates a modified version of the logical view 
of the VSI switch 19 depicted in FIG. 4. In FIG. 6B, two of 
the many possible PVCs 720 and 722 through the switch are 
logically depicted as well as the functional elements for 
processing those PVCs. In addition to the elements of the 
switch 19 already described in relation to FIG. 4, each PVC 
720 and 722 has an ingress queue set 702. The switch 19 also 
maintains an egress queue 704 populated from the individual 
ingress queues 702. The remaining elements illustrated in 
FIG. 6B are identical in name and function to those 
described in relation to FIG. 4 and, therefore, a redundant 
description of these elements will be avoided. 

In each PVC flow 720 and 722 through the switch 19, a 
set of ingress queues 702 is provided that prioritizes down- 
stream data according to a level of service rule -set applied 
to the downstream traffic when examined at a layer above 
the ATM layer. Both the downstream traffic from the vertical 
services domain and the downstream traffic from the ISP 
domain can be queued in the egress queue set 704 according 
to a predetermined SLA. The downstream ATM traffic 
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generated from each of the ingress queues 702 of the 
different PVCs is then prioritized into egress queue 704 
according to an ACL that controls the servicing of the 
ingress queues 702 by specifying relative priorities of the 
different PVCs 720 and 722 that are destined for the same 5 
RTDSLAM. Accordingly the modified switch of FIG. 7B 
and its two-tier queuing structure allows prioritization of 
down stream traffic within each PVC 720 and 722, for 
example, and among the different PVCs being switched 
through the switch 19. 

While the foregoing has described what are considered to 
be the best mode and/or other preferred embodiments of the 
invention, it is understood that various modifications may be 
made therein and that the invention may be implemented in 
various forms and embodiments, and that it may be applied 
in numerous applications, only some of which have been 15 
described herein. It is intended by the following claims to 
claim any and all modifications and variations that fall 
within the true scope of the inventive concepts. 

What is claimed is: 

1. A method for queuing downstream traffic in a data 20 
communications network in order to prioritize the down- 
stream traffic according to tiers of service, comprising the 
steps of: 

receiving a plurality of frames destined for subscriber ^ 
equipment, each of said plurality of received frames 
associated with one of a plurality of logical communi- 
cations pipes, and each of said plurality of logical 
communications pipes having an associated level of 
quality and an associated set of ingress queues; ^ 

queuing each one of the plurality of received frames, 
based on information within that one frame, in a 
particular queue within the set of ingress queues that 
correspond to the logical communications pipe associ- 
ated with that one frame, wherein each queue within 35 
each of the sets of ingress queues has a first associated 
priority level; 

servicing the plurality of sets of ingress queues based on 
at least one of the first associated priority levels of each 
queue within each of the plurality of sets of ingress 40 
queues and the level of quality associated with each of 
the sets of ingress queues, to populate a set of egress 
queues, each queue within the set of egress queues 
having a second associated priority level; and 

servicing each queue of the set of egress queues based on 45 
the second associated priority level of each queue, to 
provide downstream traffic prioritized into different 
tiers of service. 

2. The method according to claim 1, further comprising 
the step of: 50 

determining data within each of the plurality of received 
frames relating to a network protocol layer above the 
data-link layer and wherein the queuing of each 
received frame is based on the determined data for that 
frame. 55 

3. The method according to claim 2, wherein the deter- 
mined data identifies a type of service associated with each 
of the plurality of received frames. 

4. The method according to claim 1, wherein the servicing 

of the plurality of sets of ingress queues is based on a 60 
temporary storage capacity, in one or more downstream 
facilities, associated with each of the logical communica- 
tions pipes. 

5. A 'method for queuing downstream traffic destined for 

a remote terminal DSLAM, comprising the steps of: 65 
receiving a plurality of frames, each frame associated with 
one of a plurality of virtual circuits, each of said 
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plurality of virtual circuits having a corresponding level 
of service and a corresponding set of ingress queues 
wherein each of said plurality of received frames is 
thereby associated with a set of ingress queues; 
based on data within each of the plurality of received 
frames, placing each of the plurality of received frames 
in a particular one of the queues within the set of 
ingress queues that correspond to the virtual circuit 
associated with that frame, each of queues within each 
of the sets of ingress queues having a corresponding 
priority level; 

servicing the plurality of sets of ingress queues based on 
at least one of the associated priority levels of the 
queues within each of the sets of ingress queues and the 
corresponding level of service of each of the sets of 
ingress queues, to populate a set of egress queues with 
the plurality of received frames, each of the queues 
within the set of egress queues having an associated 
priority level; and 

servicing the set of egress queues according to the cor- 
responding priority levels of the queues within the set 
of egress queues to generate traffic destined for the 
remote terminal DSLAM. 

6. The method according to claim 5, wherein the data 
within each of the received plurality of frames relates to one 
of network-layer and transport-layer information. 

7. The method according to claim 5, wherein the data 
within each of the received plurality of frames relates to a 
type of service associated with that frame. 

8. The method according to claim 7, wherein the type of 
service is one of video service, data service and voice 
service. 

9. The method according to claim 5, wherein each of the 
received plurality of frames is received from one of an 
internet services domain and a vertical services domain. 

10. The method according to claim 5, wherein the ser- 
vicing of the plurality of sets of ingress queues is based on 
a data buffering capacity, in the remote terminal DSLAM, 
associated with each of the virtual circuits. 

U. A data switch for use in a communications network, 
comprising: 

a first interface, for communication with a first network 
domain via a plurality of virtual circuits, each virtual 
circuit having a corresponding level of service; 

a second interface, for data communication to and from 
data equipment at a plurality of customer premises via 
the plurality of virtual circuits; 

a switch fabric coupled to the interfaces and configured to 
forward downstream data from the first interface to the 
second interface according to the plurality of virtual 
circuits; 

a plurality of sets of first-tier queues coupled with the first 
interface, each of said sets of first-tier queues associ- 
ated with one of the plurality of virtual circuits and each 
of said sets comprising a first plurality of queues, each 
of said first plurality of queues having an associated 
priority level; 

a second-tier queue set coupled with the second interface 
and comprising a second plurality of queues each of 
said second plurality of queues having an associated 
priority level; and 
a switch controller configured to: 
place each particular frame of a plurality of frames, 
associated with a corresponding one of the plurality 
of virtual circuits, received at the first interface from 
the first network domain, into a one of the first 
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plurality of queues within one set of first-tier queues 
associated with that corresponding one virtual 
circuit, based on information within each said par- 
ticular frame; 

service each of the sets of first-tier queues, to populate 5 
the second plurality of queues within the second-tier 
queue set, according to at least one of: 

a) the associated priority levels of the first plurality 
of queues within that set of first-tier queues, and 

b) the corresponding level of service of the virtual 10 
circuit associated with that set of first-tier queues; 
and 

service the second-tier queue set according to the 
associated priority levels of the second plurality of 
queues within the second-tier queue set, to generate 15 
traffic for transmission via the second interface. 

12. The switch according to claim 11, further comprising: 
an access control list that identifies the corresponding 

level of service for each virtual circuit. 

13. The switch according to claim 11, further comprising: 20 
a third interface for communication with a second net- 
work domain and coupled with the plurality of sets of 
first-tier queues; and 

wherein said switch controller is farther configured to: 25 
insert each of a plurality of frames from the second 
network domain, received via the third interface, into 
a specific virtual circuit by placing each of the 
plurality of frames from the second network domain 
into one of the first plurality of queues within a set 3Q 
of first-tier queues associated with that specific vir- 
tual circuit, based on information within each of the 
plurality of frames from the second network domain. 

14. The switch according to claim 13, wherein the first 
network domain comprises an internet services domain and 35 
the second network domain comprises a vertical services 
domain. 

15. The switch according to claim 11, wherein the infor- 
mation within each said particular frame relates to a network 
protocol layer above a data -link layer. 4Q 

16. The switch according to claim 11, wherein the infor- 
mation within each said particular frame indicates a type of 
service associated with mat particular frame. 

17. The switch according to claim 16, wherein the type of 
service is one of voice service, data service, and video' 
service. 

18. In an access data network, comprising: 

a communication access node coupled to a wide area 
internetwork; 

a plurality of digital subscriber line transceivers coupled 50 
to network ends of subscriber lines, for data commu- 
nication with transceivers coupled to respective cus- 
tomer premises ends of respective subscriber lines; 

an access switch coupled for data communications with 
the digital subscriber line transceivers, for receiving 55 
data from customer premises equipment via respective 
ones of the digital subscriber line transceivers and for 
supplying data intended for transmission to predeter- 
mined customer premises equipment to the respective 
ones of the digital subscriber line transceivers; 60 

a remote terminal DSLAM between the access switch and 
the plurality of digital subscriber transceivers, said 
remote terminal DSLAM including a plurality of 
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buffers, each buffer associated with one or more of the 
subscriber lines; 
a high-speed data link between the access switch and the 

communication access node; 
a local services network coupled locally to the access 
switch, wherein the access switch segregates upstream 
traffic from the respective customer premises equip- 
ment between the local services network and the high- 
speed data fink to the communication access node, and 
the access switch aggregates downstream traffic from 
the local services network and the high-speed data link 
from the communication access node for transmission 
to the respective customer premises equipment, 
a method of providing different tiers of quality to the 
different subscriber lines, each different subscriber line 
having an associated set of similar ingress queues, the 
method comprising the steps of: 
queuing the aggregated downstream traffic in each of 
the different subscriber lines into one of a plurality of 
queues within the set of ingress queues associated 
with that subscriber line, based on a type of service 
associated with the aggregated downstream traffic; 
populating a set of egress queues with the aggregated 
downstream traffic from all of the different sub- 
scriber lines by servicing the different sets of ingress 
queues according to at least one of a priority level 
associated with each of the plurality of queues within 
the different sets of ingress queues and a level of 
quality associated with each of the different sets of 
ingress queues; and 
servicing the set of egress queues according to a 
priority level associated with each of the queues 
within the set of egress queues to generate down- 
stream traffic through the RTDSLAM having differ- 
ent tiers of quality. 

19. The method according to claim 18, wherein: 
services are provided through the access data network to 

customer premises equipment of each customer via a 
logical circuit provisioned through the access data 
network, the logical circuit extending from the cus- 
tomer premises equipment of each customer to the 
communication access node via the access switch and 
the high-speed data link, and 
the logical circuit comprises a layer-2 protocol logical 
communication circuit provisioned through the access 
switch and the high-speed data link. 

20. The method according to claim 19, wherein the 
layer-2 protocol logical communication circuit comprises an 
Asynchronous Transfer Mode (ATM) virtual circuit. 

21. The method according to claim 19, wherein the logical 
circuit has a corresponding level of quality. 

22. The method according to claim 18, further comprising 
the steps of: 

determining a data capacity of each of the plurality of 
buffers; and 

servicing each of the different sets of ingress queues 
according to the determined data capacity of the buffer 
associated with the subscriber line corresponding to 
that set of ingress queues. 
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